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ON NONUNIQUENESS OF SOLUTIONS OF 
HAMILTON-JACOBI-BELLMAN EQUATIONS 

ARKADIUSZ MISZTELA f 


Abstract. An example of a nonunique solution of the Cauchy problem of Hamilton- 
Jacobi-Bellman (HJB) equation with surprisingly regular Hamiltonian is introduced. The 
proposed Hamiltonian i7(£, x^p) fulfills the local Lipschitz continuity with respect to the 
triple of variables (£, a:,p), in particular, with respect to the state variable x. Moreover, 
the mentioned Hamiltonian is convex with respect to p and possesses linear growth in 
p, so it satisfies the classical assumptions. Given HJB equation with the Hamiltonian 
satisfying the above conditions, two distinct lower semicontinuous solutions with the 
same final conditions are given. Moreover, one of the solutions is the value function 
of Bolza Problem. The definition of lower semicontinuous solution was proposed by 
Frankowska [9] and Barron-Jensen [4]. The example that is proposed in the current 
paper allows to understand better the role of Lipschitz-type condition in the uniqueness 
of the Cauchy problem solution of HJB equation. 
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1. Introduction 

The classical Cauchy problem for the Hamilton-Jacobi-Bellman equation is a partial dif¬ 
ferential equation with the final condition 

-Ut+H{t,x,-Ux) = Q in ]0,r[xIR", 

U{T,x)=g{x) in R”. 

If the Hamiltonian H{t,x,p) is convex with respect to p, then there are relations between 
solutions of HJB and optimization problems involving a function dual to the Hamiltonian. 
This function, called the Lagrangian and denoted by L, is derived from H with the use of 
Legendre-Fenchel transform, namely: 

(1.1) Llt,x,v) = sup {{v,p) - Hlt,x,p)}. 

pSR" 

Here {v,p) denotes the inner product of v and p. It is possible for L to assume value J-oo. 
We consider the problem of Bolza in (to, a:o) to be 

(Vto,xo) minimize T{x{-)) := g{x{T)) + f L{t,x{t),x{t)) dt, 

Jto 

where F is minimized over A([to,T"], 1^") (the space of all absolutely continuous functions 
X : [to,T] — >■ R" satisfying x{to) = Xq). We say that Hamiltonian H{t,x,p) satisfies the 
classical optimality conditions, if it fulfills locally the Lipschitz continuity with respect to 
the system (t,x,p). In addition to this, H(t,x,p) is convex with respect to p and increases 
linearly in p. The well-known result of Rockafellar [21] states that if the Hamiltonian H 
satisfies the classical optimality conditions and the function g is lower semicontinuous (Isc), 
then there exists at least one solution of {'Pto,xo)- 

The set dom/ = {x : f{x) ^ ± 00 } is called the effective domain of /. An extended- 
real-valued function is called proper if it never takes the value —00 and dom / ^ 0. When 
H{t,x, ) is proper, Isc and convex for each {t,x), then L{t,x,-) also has these properties. 
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Furthermore, if this is the case, we can retrieve H from L by performing the Legendre- 
Fenchel transform for a second time: 

(1.2) H{t,x,p)= sup {{p,v) - L{t,x,v)}. 

Thus we have a one-to-one correspondence between Hamiltonians and Lagrangians in this 
convex case, and every equation like HJB can be related to a problem of the form {Vta,xo)- 

Definition 1.1. The V : [0,T] x R" —>■ RU {+oo} is dehned using of F as follows: 


(1.3) V{to,xo) 


inf{F(a;(-)) : a;(-)G^([to,F],R"), a;(to) = a:o } if to<T, 
9{xo) if to = T. 


If the value function is differentiable, it is well-known that it satisfies HJB in the clas¬ 
sical sense. However, in many situations the value function is not differentiable. Then the 
solution of the HJB equation must be defined in nonsmooth sense in such a way that under 
quite general assumptions on H and g, V is the unique solution of HJB. Since we use the 
nonsmooth analysis we need a notion of a subgradient. For a vector v G R" and a function 
/ : R” —>• R U {±oo}, u is a subgradient of / at a: G dom/, written v G df{x), if 

(1.4) limint /fa)-/(»)-(»■■»-"> j 0- 

y^x,y^x \y — X\ 

In 1980 Crandall and Lions [7] introduced a nonsmooth viscosity solutions, and Crandall, 
Evans, and Lions gave a simplified approach in [6]. Viscosity solutions attracted a lot 
of attention, and over subsequent years a sizable literature developed from many authors 
that dealt with it. Among other issues, existence and uniqueness of solutions was considered. 
Usually in the viscosity theory we have assumptions about continuity of solutions (see [2, 3]). 

In 1990 Baron-Jensen [4] and Frankowska [9] introduced extend viscosity solutions to 
semicontinuous functions for Hamiltonian that is convex in p and provided a uniqueness 
result. Frankowska [9] called these solutions lower semicontinuous solutions. 

Definition 1.2. A function U : [0,T] x R" —>■ R U {+oo} is lower semicontinuous solution 
of HJB if it satisfies the following: 

(i) U is lower semicontinuous function and U{T,x) = g{x)', 

(ii) For every {t,x) G domC/, every {pt,Px) G dU{t,x) the following holds: 

r -pt+ H{t,x,-px) =t) if t e]0,T[, 

(1.5) < -pt + H{t,x,-px) 0 if t = 0, 

[ -pt + H{t, X, -px) ^0 if t = T. 


The main goal of the current paper is to present an example of two distinct lower semi¬ 
continuous solutions of HJB with surprisingly regular Hamiltonian. The proposed Hamil¬ 
tonian H : [0, T] X R X R —>■ R is, firstly, convex with respect to p, secondly, it increases 
linearly in p, i.e. \H{t,x,p)\ ^ 2|p| for any t G [0,T], x,p G R, thirdly, it satisfies locally the 
Lipschitz continuity, i.e. 

, . yr > 0 3k > 0 yt,s £ [0,T] yx,y £ rB 'ip,q G rB 

\H{t,x,p) - H{s,y,q)\ !^k{\t-s\ + \x-y\ + \p-q\), 


where H is a closed unit ball. Thus the above Hamiltonian satisfies the classical optimality 
conditions. In addition, we show that one of the indicated lower semicontinuous functions is 
the value function given by (1.3). In many cases, the Lipschitz continuity (LLC) is sufficient 
for the solution of HJB to be unique. It turns out that, in general, for the uniqueness of 
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the solution, one needs some stronger Lipschitz-type condition, that we shall study further 
in connection to the results of uniqueness of solution of HJB. 

Frankowska [9] proved that, the value function is the unique lower semicontinuous solution 
of the HJB equation if the Hamiltonian meets the classical optimality conditions and it is 
positively homogeneous in p, i.e. Vr.>o H{t,x,rp) = rH{t,x,p). Actually, the result of 
Frankowska does not require local Lipschitz continuity with respect to the triple {t,x,p). 
It is enough to assume it is satisfied with respect to state variable x only. The example 
of nonuniqueness of solution of HJB introduced in the current paper, does not contradict 
the result of Frankowska as the Hamiltonian in our example, fulfills the classical optimality 
condition, but it is not positively homogeneous in p. 

Earlier Ishii [13, Thm. 2.5] and Crandall-Lions [8, Thm. VI. 1] had proved the uniqueness 
of viscosity solutions of HJB in the class of continuous functions. They had assumed instead 
of linear growth in p of Hamiltonian, the following condition 

, . dC > 0 Vt G [0,r] Vx G R” Vp,gG R” 

\H{t,x,p) - H{t,x,q)\ ^ C\p-q\. 

One can show that if the Hamiltonian is convex in p and possesses a linear growth of the 
form \H{t,x,p)\ ^ 2|p|, then the condition (1.6) holds with constant C = 2. Therefore the 
Hamiltonian from our example of nonuniqueness also satisfies (1.6). Next, the results in [13, 
Thm. 2.5[ and [8, Thm. VI. 1] require the Lipschitz-type condition for the Hamiltonian with 
respect to state variable x, 

Vr > 0 3 /c > 0 Vt, s G [0, T] Vx, j/ G ri? Vp G R" 
\H{t,x,p)-H{s,y,p)\^k{l + \p\){\t-s\ + \x-y\), 


that is derived from the optimal control problem. The meaning of (SLC) in the optimal con¬ 
trol problems is discussed in the papers of Rampazzo [20] and Frankowska-Sedrakyan [10]. 
The results in [13, Thm. 2.5] and [8, Thm. VI.1] do not require the convexity of the Hamil¬ 
tonian in p, but the uniqueness of solution of HJB is obtained in the class of continuous 
functions. Using these results, Bardi and Capuzzo-Dolcetta [2, ch. V, Thm. 5.16] showed 
the uniqueness of solution of HJB in the class of lower semicontinuous functions assuming 
additionally the convexity of the Hamiltonian in p. Because the Hamiltonian in our example 
of nonuniqueness satisfies the classical optimality conditions, also the condition (1.6) is sat¬ 
isfied. It means that in the uniqueness results, the key point is the Lipschitz-type condition 
(SLC), at least in the case of lower semicontinuous solutions of the HJB equation. 

The conditions presented above, needed for uniqueness of solution of the HJB equation, 
are classical conditions originated from optimal control theory. The conditions (1.6) and 
(SLC) in their stronger forms appear in the fundamental work of Crandall and Lions [7]. It 
follows from our example of nonuniqueness that the locally Lipschitz continuity (LLC) is not 
in general sufficient for the uniqueness of the solution of HJB. Therefore, the Lipschitz-type 
condition (SLC) has to be stronger than (LLC), because (SLC) implies the uniqueness of 
the solution of HJB. Let us now look more precisely at the difference between these two 
conditions. If Hamiltonian satishes (LLC), putting p = q and increasing the right-hand side 
of the inequality, we get 


\H{t,x,p) - H{s,y,p)\ ^ k{\t - s\ + \x - y\) 

(1.7) ^ A:(l-f |p|)(|t-s|-f jx-pj), 

for any t, s G [0,T], x,y G rB and p G rB. We notice that the inequality (1.7) is identical 
with the one of (SLC). The only difference is that the inequality (1.7), assuming (LLC), 
holds only for p G rB, and assuming (SLC), it holds for all p G R". This subtle difference 



4 


ARKADIUSZ MISZTELA 


gives totally different results about the uniqueness of the solution of the HJB equation, as 
it is shown in our example of nonuniqueness. Finally, we notice that if the Hamiltonian is 
positively homogeneous in p, then the condition (SLC) follows from (LLC). 

In order to understand better the reason for nonuniqueness of the solution of the HJB 
equation given in our example, we need to recall the Loewen-Rockafellar condition [15] 
that is more general version of (SLC). This condition is some kind of Aubin continuity of 
multifunction {t,x) —>■ epiL(t, x, •), where epi/(-) = {(x,r) : f{x) ^ r}. This approach 
was used by Loewen-Rockafellar [15, 16] to study necessary conditions of optimal solution 
of Bolza problem {Pto,xo)- The results of this research used Galbraith from [11] in order to 
prove that the value function is the unique lower semicontinuous solution of HJB. Assuming 
the convexity of Hamiltonian in p, its mild growth in p and that it satisfies the Loewen- 
Rockafellar condition [15], the Galbraigth uniqueness result of the solution of HJB has 
rather general nature including not only optimal control problems, but also variational 
problems. In our example of nonuniqueness, based on Galbraith result, we are able to 
indicate the element of construction of the Hamiltonian that corresponds to the lack of 
uniqueness. Namely, changing the corresponding element of construction, we obtain the 
Hamiltonian that does not satisfy the condition (SLC), while it satishes Loewen-Rockafellar 
condition [15]. Therefore, by virtue of classical results, we are not able to say if after the 
mentioned change, we get the uniqueness of the solution of HJB or not. However, using the 
Galbraigth result [11], we know that HJB with this Hamiltonian has the unique solution. 
Thus the changed element of the Hamiltonian construction must be responsible for the lack 
of uniqueness. 

In the literature, the example of nonuniqueness of the solution of the equation of HJB is 
known. Crandall and Lions in their fundamental article [7] give an example of nonuniqueness 
of viscosity solution of the transport equation 

(1.8) Ut + b{x) ■ U, = 0. 

The construction of their example is based on Beck results [5]. In this example, the Hamil¬ 
tonian H{t,x,p) = b{x) p is continuous, but it does not satisfy the local Lipschitz continuity 
with respect to the state variable x. The example given by Crandall-Lions is natural, as one 
knows, that continuity is, in general, not sufficient condition for uniqueness of the solution of 
the Cauchy problem. Of course, if the function b{x) satishes locally the Lipschitz continuity, 
then there exists the unique viscosity solution of the equation (1.8). Hence the continuity 
of b{x) is the necessary condition for hnding two different viscosity solutions of (1.8). The 
Hamiltonian in our example of nonuniqueness is of different type from the one discussed 
above and satishes locally the Lipschitz continuity with respect to the triple {t, x,p), in par¬ 
ticular, with respect to the state variable x. The solutions in the Crandall-Lions example 
are continuous, and in our example, they are lower semicontinuous. In connection to this, 
a question arises - do there exist two different continuous viscosity solutions of HJB with 
the Hamiltonian satisfying locally the Lipschitz continuity with respect to the state vari¬ 
able? We do not know the answer to this question but we believe that it is positive. Such 
an example of nonuniqueness would explain the meaning of Lipschitz-type condition in the 
results of uniqueness of the solution of HJB in the class of continuous functions. 

Summarizing, our example of nonuniqueness shows that the key role in the uniqueness 
of viscosity solutions of HJB is played by the Lipschitz-type conditions originated in op¬ 
timization instead of local Lipschitz continuity originated in differential equations theory. 
Therefore our result is presented in the aspect of optimization problems. 

We discovered the example of nonuniqueness while we were working on generalization of 
results of Plaskacz-Quincampoix [19]. They are contained in [18]. 
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2. Existence and uniqueness theorems 

In this section we present known theorems on existence and uniqueness of lower semicon- 
tinuous solutions of the HJB equation. We discuss results of the paper on the basis of these 
theorems. First, we introduce basic assumptions on Lagrangian. 

(LI) L : [0,T] X R” x M" —>■ R U {+cx)} is lower semicontinuous; 

(L2) L{t,x,v) is convex and proper with respect to v for every {t,x)G [0,r] xR”; 

(L3) L{t,x,v) ^ 0 for all {t,x,v) G [0,T] x R” x R"; 

(L4) there exists a constant C > 0 such that for every (t, x, v) € [0, T] x R" x R" 
the following implication is satished |r;| > C(1 + |a:|) L{t,x,v) = +oo; 

(L5) for any point {t,x,v) where L{t,x,v) is finite, and for any sequence (tn,Xn) (t,x), 
there exists a sequence Vn^v along with L{tn,Xn,Vn) —>■ L{t,x,v). 

Assumption (L4) is some kind of coercivity of the Lagrangian L, and the condition (L5) 
gives lower semicontinuity of the multifunction {t,x) —>■ epi L{t, x, ■) in the sense of Kura- 
towski. More information about (L5) can be found in the paper [22]. We say that a function 
x(-) at the point (to,xo) G domU, to G [0,T[ is optimal trajectory of {Vto,xo), if it achieved 
the value V{to, xo) in {VtQ^xo)- The function x{-) satisfying also Lipschitz continuity is called 
the Lipschitz optimal trajectory. 

Theorem 2.1 (Existence). Assume that L satisfies (LI)-(L5) and g is Isc and bounded 
from below. Let V be a value function associated with g and L. Then the value function V is 
bounded from below lower semicontinuous solution of the HJB equation with the Hamiltonian 
H given by (1.2). Moreover at every point {to,xo) G domU, to G [0,T[ there exists the 
Lipschitz optimal trajectory of {Vto,xo)- 

Theorem 2.1 is a consequence of more general Theorems 3.4 and 4.3 from [18]. Directly 
from the condition (L4) and Gronwall’s inequality we have that optimal trajectories in Bolza 
problem {'Pta,xo) satisfy the Lipschitz continuity. In Section 3 we show that Lagrangian in our 
example on nonuniqueness satisfies conditions (L1)-(L5). Therefore, from Theorem 2.1 the 
value function is the lower semicontinuous solution of the HJB equation. Thus, the question 
is - if the value function is one of two distinct solutions of our example on nonuniqueness? 
The answer to this question is given in Section 5. Now we present an equivalent version of 
conditions (L1)-(L5) that are expressed by Hamiltonian. 

Proposition 2.2. Suppose that L, H are related by (1.1), (1-2), respectively. Then L 
satisfies (L1)-(L5) if and only if L satisfies (H1)-(H4): 

(HI) H : [0,T] X R" x R” —>■ R is upper semicontinuous; 

(H2) H{t,x,p) is convex with respect to p for every {t,x) G [0,T] x R"; 

(H3) there exists a constant C > 0 such that for all {t,x,p) G [0,T] x R” x R” 
the following inequality is satisfied H{t,x,p) ^ C(1 + |a;|)|p|; 

(H4) H is lower semicontinuous on [0,T] x R" x R". 

Condition (H3) is called a linear growth in p of the Hamiltonian. Proposition 2.2 come 
from properties of Legendre-Fenchel transform and Wijsman theorem, details can be found 
in [22, 23]. Having conditions (H1)-(H4) we can formulate the theorem on uniqueness of 
lower semicontinuous solution of the HJB equation. 

Theorem 2.3 (Uniqueness). Suppose that H satisfies (H1)-(H4) and (SLC). Let g be Isc 
and bounded from below, and V be a value function associated with g and L, where L is given 
by (1.1). If U is bounded from below lower semicontinuous solution of the HJB equation, 
then U=V on [0,r] x R”. 
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Theorem 2.3 is a particular case of Theorem 2.2 from [11]. In Section 3 we show that 
Hamiltonian from our example on nonuniqueness satisfies conditions (H1)-(H4) and the 
Lipschitz continuity (LLC). It means that the condition (SLC) is stronger than (LLC), since 
from Theorem 2.3 it implies uniqueness of solution of the HJB equation. 

Now we discuss the Lipschitz-type condition Loewen-Rockafellar [15] that is a more gen¬ 
eral version of the condition (SLC). In Section 6 we show that this condition explains what 
is the reason of the lack of uniqueness in our example. We start with a subgradient char¬ 
acterization of the condition (SLC). A subgradient is defined for the function given on the 
whole Euclidean space (see Def. 1.4), so to use a subgradient to the Lagrangian L we extend 
L in the following way L{t,x,v) := L{0,x,v) for t<0 and L{t,x,v) := L(T,x,v) for t>T. 

For every r > 0 there exists A: > 0 such that at every point {t, x, v) 

(2.1) e [OjT] X rB X R”, every {wi,W 2 ,p) G dL{t,x,v) the inequality 
|(r(;i,r(; 2 )| ^ k{l + |p|) holds. 

Condition (2.1) is equivalent to (SLC), if Hamiltonian satisfies (H1)-(H4). Moreover, one 
can prove that the condition (2.1) is a subgradient characterization of Lipschitz continuity 
of the multifunction {t,x) —>■ epiL{t,x, •) in the Hausdorff’s sense. Besides, it is easy to see 
that the condition (2.1) implies the following one: 

For every r > 0 there exists fc > 0 such that at every point {t, x, v) 

(2.2) G [OjT] X rB X R”, every {wi,W 2 ,p) G dL{t,x,v) we have 
|(wi,u; 2 )| ^ fc(l -k |u| -k \L{t,x,v)\){l + \p\). 

In Section 6 we show that the opposite implication to the above one is not true. It means that 
the condition (2.2) is a more general version of the condition (2.1). Furthermore, the condi¬ 
tion (2.2) is a subgradient characterization of some kind of Aubin continuity of multifunction 
{t,x) —>■ epiL(t,x,-). This kind of Aubin continuity was introduced by Loewen-Rockafellar 
[14, Def. 2.3, (b)] to study optimal control problems with an unbounded differential inclu¬ 
sion. However, a subgradient characterization can be found in [12, Prop. 3.4]. The condition 

(2.2) in a slightly weaker subgradient version exists in papers of Loewen-Rockafellar [15, 16] 
where one investigates necessary conditions of optimal solutions of Bolza problem. It means 
that conditions (2.1) and (2.2) are strictly related to optimization problems. Using results 
of Loewen-Rockafellar [14, 15, 16] Galbraith proves in [11] that the value function is the 
unique lower semicontinuous solution of the HJB equation. He obtains this result assuming 
convexity of Hamiltonian with respect to p, a mild growth of Hamiltonian with respect to 
p and slightly more general Lipschitz-type condition than (2.2). Thus, if we replace the 
condition (SLC) by (2.2) in Theorem 2.3, then the claim of Theorem 2.3 still holds. 

In [11, 12, 15, 16] one uses a limit subgradient that is more general than the regular 
subgradient that we use. We know that replacing the regular subgradient by the limit one the 
condition (2.2) is unchanged if we assume that Hamiltonian is continuous. Besides, without 
influencing the condition (2.2) we can replace (wi,W2,p)€dL(t,x,v) by (wi,W2,v)€dH{t,x,p) 
(see [11], Prop 2.6). We also know that the condition (2.2) implies (LLC) (see [11], Prop. 
2.4). Therefore, assuming conditions (H1)-(H4) or (L1)-(L5) from the above argumentation 
we obtain 

(2.3) (SLC) ^ (2.2) ^ (LLC). 

In the paper we show that the implications (2.3) cannot be reversed. Besides, we prove 
that the Lipschitz continuity (LLC) coming from differential equations is not sufficient for 
uniqueness of lower semicontinuous solution of the HJB equation. However, conditions 
(SLC) and (2.2) coming from optimization problems are sufficient for uniqueness. 
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3. Example of Hamiltonian 

In this section we define Hamiltonian and discuss its regularity. In the next section we show 
that the HJB equality with this Hamiltonian does not have the unique lower semicontinuous 
solution. First, we define an auxiliary function : [0, T] x K. —>■ R by the formula 

(3.1) exp (2^y\t - . 

The Hamiltonian H : [0,T]xIRxR—J-Ris defined by the formula 

f 0 */ 2b| ^ t ^ X, 

(3-2) H{t,x,p) = l 2|p|-^^ if 2\p\>^^,t^x, 

y 0 i/ p G R, t = x. 

It is not difficult to see that the Hamiltonian H{t,x,p) given by (3.2) is continuous on 
[0, T] X R X R, convex with respect to p for each {t, x) G [0, T] x R and has a linear growth 
in p, i.e. \H{t,x,p)\ < 2|p| for all t G [0,r], x,p G R, so it satisfies (H1)-(H4). 

Remark 3.1. The function (3.1) does not satisfy the local Lipschitz continuity on the set 
[0,T] X R, because it is not Lipschitz on neighbourhoods of points {t,x) such that t = x. 
However, Hamiltonian (3.2) defined using the function (3.1) satisfies the local Lipschitz 
continuity on [0, T] x R x R. 

Now we will prove that Hamiltonian (3.2) satisfies locally the Lipschitz continuity on 
[0,T] X R X R. We introduce some notations: by LS(-) and RS(-) we denote left and right 
side, respectively, of an equality or an inequality (•). Besides, by B{x,r) we denote a closed 
ball at a center x and radius r. 


Theorem 3.2. The Hamiltonian H given by (3.2) satisfies locally the Lipschitz continuity, 
i.e. for each {to,xo,po) G [0,T] x R x R there exist numbers r,k> 0 such that 

. , \/t,s G B{to,r) \/x,y G B{xo,r) Vp,gGH(po,r) 

\H{t,x,p) - H{s,y,q)\ ^ k{\t - s\ + \x - y\ + \p- q\). 


Proof. For 0 ^ 0 we define an auxiliary function / by the formula f{6) = exp(2-\/0). We 

notice that the function / is increasing and f{\t — x\) = p{t,x). Furthermore, the function / 
on [a, b] satisfies Lipschitz continuity if 0 < a < 5. We fix to G [0, T], xo,Po G R and consider 
two cases 

Case 1. Let po G R and tg = xg. We define r := l/[2exp(4)(l + 2|po|)^] and k := 1. 
We notice that |p| < r + |po| for p G B{po,r) and \t — x\ < 2r for t G B(to,r), x G B{xg,r), 
besides r ^ 1/2. Therefore, ioi t x we obtain 


2|p| ^ 2(r + IpoI) < 1 + 2|po| 


1 1 1 

V^exp(2) ^ /(2r) ^ f{\t-x\) 


1 

(p{t,x)' 


By the definition of the Hamiltonian H{t,x,p) = 0ifpGR, t = a; and 2|p| ^ l/(p{t,x), 
t ^ x. Therefore, H{t,x,p) = 0 for each t G B{tg,r), x G B(xo,r), p G B{pg,r), so we have 
the inequality (3.3). 

Case 2. Let po G R and to 7^ xg. We define r by the formula r = \tg — a;o|/3, then 
r ^ ~ a;| ^ 5r for each t G B{tg,r), x G B{xo,r). Let I be the Lipschitz constant of the 

function / on [r, 5r]. We define k hy k := 2 + 1/f‘^{r). 

Since t ^ x for each t G B(to,r), x G B{xg,r), then by the definition of the Hamiltonian 
(3.2) we obtain the following relations 


(a) For 2|p| ^ l/(p{t,x) and 2\q\ ^ l/(p{s,y) we have the inequality 

LS(3.3) = 0 < RS(3.3). 
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(b) For 2\p\ ^ \/Lp(t,x) and 2\q\ ^ \/Lp{s,y) we have inequalities 

LS(3.3) < 2lp - _ ^1_ ^1) 1/(1* - - /(!» - !/l)l 

^ ‘2\p-q\ + -p^{\t-s\ + \x-y\) 

rir) 

^ RS(3.3). 


(c) For 2\p\ > l/p{t,x) and 2\q\ ^ l/p{s,y) we have inequalities 

1 1 


LS(3.3) ^ 2\p\ - 


(p{t,x) 

^ 2|p-g| + 


pis,y) 

1 


-2k| 


fi\t-x\)fi\s-y\) 

< RS(3.3). 

The consequence of cases (a)-(c) is the inequality (3.3). 


l/(l^-a^l)-/(|s-y|)l 


□ 


Remark 3.3. The local Lipschitz continuity from Theorem 3.2 is equivalent to the Lipschitz 
continuity follows from compactness of closed and bounded sets in Euclidean spaces M". 
Therefore, by Theorem 3.2 Hamiltonian (3.2) satisfies the Lipschitz continuity (LLC). 

Now we prove that Hamiltonian (3.2) does not satisfy the condition (SLC). The proof 
of this fact shows how condition (SLC) is violated for large values of p. Moreover, from 
Theorem 3.2 we have that the condition (LLC) is weaker than the condition (SLC). 

Proposition 3.4. Hamiltonian (3.2) does not satisfy the condition (SLC). 

Proof. Assume that the condition (SLC) is satisfied. Then setting sq = yo and 
Pn = l/ip{tn,Xn), where tn Xn, we get 

\j pitji^Xjf) — \H (fm Xnj Pn) H (^Sq^ yQj Pn)\ 

< fc(l + l/(p{tn,Xn))i\t„ - Sol + \Xn “ 2/0 I) ■ 

Multiplying the above inequality by (p(tn,Xn) we obtain the inequality 
1 ^ A:(v3(t„,a;„) + l)(|t„ - Sol + |x„ - 2/o|), 

that gives us the contradiction if {tn,Xn) (so,2/o)- D 


The Lagrangian L : [0, T] x R x K. —>■ R U {+ 00 } is defined by the formula 


(3.4) 


L(t, X, v) = 


+00 


2(p{t,x) 

0 


+00 


*/ kl >2, tj^x, 

if |u| <2, t^x, 
if V = 0, t = X, 
if V ^ 0, t = X. 


It is not difficult to prove that the Lagrangian (3.4) satisfies conditions (L1)-(L5). We 
show that the Hamiltonian (3.2) is Legendre-Fenchel transform of the Lagrangian (3.4) 
with respect to the last variable, i.e. it satisfies the equality (1.2). 


Proposition 3.5. The Hamiltonian H and the Lagrangian L given by (3.2) and (3.4), 
correspondingly, satisfy the equality (1.2). 
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Proof. To prove the proposition we consider two cases t ^ x and t = x. 
Case 1. Let t x, then by the dehnition of the Lagrangian (3.4) we have 


(3.5) 

(3.6) 


H{t,x,p) = 


< 


sup 



2(p{t,x) J 


sup |v| 


\p\ 


I 

2ip(t, x) 


By the inequality (3.6) we obtain the following bounds 

(3-7) H{t,x,p) ^ 2\p\ - if 2\p\ > j 

p{t,x) p{t,x) 

(3.8) H{t,x,p) ^0 if 2\p\ < j 

ip{t,x) 

We notice that in the case (3.7) we obtain the opposite inequality if we set v = ±2 in 
the equality (3.5). In the case (3.8) we get the opposite inequality, if we set v = 0 in the 
equality (3.5). Therefore, for t x the considered Hamiltonian and the Lagrangian satisfy 
the equality (1.2). 

Case 2. Let t = x, then from the definition of the Lagrangian (3.4) we have 


H{t,x,p) = p-0 — 0 = 0, 


that finishes the proof. 


□ 


Now we prove that Hamiltonian (3.2) does not satisfy the condition (2.2). The proof of 
this fact shows how condition (2.2) is violated for large values of gradients. By Theorem 3.2 
it means that the condition (2.2) is stronger than the condition (LLC). It implies that the 
second implication in (2.3) cannot be reversed. In Section 6 we will see that large values of 
gradients not necessarily violate condition (2.2). 

Proposition 3.6. Lagrangian (3.4) does not satisfy the condition (2.2). 

Proof. Let the Lagrangian L be given by the formula (3.4). Then for t > x, v G ]0, 2[ and 
{wi,W 2 ,p) G dL{t,x,v) we have 

1 1 
2(t-x) ^(t-x)_ ' 

Therefore, the left and right sides of the inequality (2.2) are given by 

LS(2.2) = RS(2.2) = t (l + . + (l + , 

Let tn — Xn ^ 0+ and = 2ip(tn,Xn)- If the inequality (2.2) is satisfied, then for large 
n G N we have 

< 2k{l + (f{tn,Xn)) (l + -xj- 

V 2(p{tn,Xn)J 

Multiplying the above inequality by 2(t„ — Xn) we have the inequality 

\/2 + 2yj2{tn - X„) < 2k[l + (p(t„,x„)] ( 2(t„ - x„) -I -= 

y exp (2^Jtn - Xn 

Taking it to the limit, we obtain contradiction. □ 



V2 


2(tn Xn) a / {tn — Xn) 


P = 


2ip{t, 


— Wi = W2 = 


2(p{t, 
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4. Solutions of HJB equation 


In this section we present two different, bounded, lower semicontinuous solutions of the HJB 
equation with the Hamiltonian H given by (3.2) and the cost function g : M. ^ M. given by 
the formula 


(4.1) 



exp (^—2y/x — T) — 1 if X ^ T, 
1 if x<T. 


Now we prove the lemma that is needed in the proof of the inequality (1.5). For the 
function / : R" —>■ R U {+oo} and z € domf we define 


(4.2) 


Af(z)(e) = 


lim 

r—>-0+ 


f(z + Te) - f{z) 
r 


Lemma 4.1 ([1, Prop. 6.4.8]). Let the function F : R^ —>■ R U {+oo} and a point (t,x) € 
domF be given. Assume that AF(t,x)(v,uj) exists. Then for each {pt,Px)&dF{t,x) we have 

(4.3) AF{t,x){v,uj) ^ptv+pxuj. 


In this paper we define some notions on the whole Euclidean space, that while applied 
to U{t,x) given on [0,r] x R” we extend U{t,x) by setting +oo for {t,x) ^ [0,T] x R”. In 
addition to this, we introduce the following notation 

ib{t,x) = —7 for t ^ X. 

(p{t,x) 


(4.4) 


4.1. First solution. Let the function [/ : [0,T] x R 

exp (—) ~ 1 


U{t,x) = 


> R be given by the formula 
if x^t, 

if X < t. 


Theorem 4.2. The function U given by (4.4) is bounded lower semicontinuous solution of 
the HJB equation with the Hamiltonian (3.2) and the terminal condition (4.1). 


Proof. It is not difficult to notice that the function U is lower semicontinuous, bounded 
and U(T,x) = g{x). We will prove that the function U satisfies conditions (1.5). To this 
end, we consider seven cases. 

Case 1. Let x > t and t G ]0,T[. Then the function [/ is differentiable at (t,x). 
Therefore, dU(t,x) = {{pt,Px)}, where pt = tpitjx) = —px- Since —2px ^ 'ip{t,x), then by 
the definition of H we have 


-pt + H{t,x,-px) = -pt-2px-i>{t,x) 

= —'ip{t,x) + 2ip{t,x) — ip{t,x) 

= 0 . 


Case 2. Let x > t and t = 0. Then the equality AU{t, a;)(l, 0) = ip{t, x) holds. Therefore, 
from the inequality (4.3) we obtain 'tf;{t,x) ^ pt for each {pt,Px) G dU{t,x). Moreover, 
AU{t, x)(0, 1) = —tpit, x) and AU{t, x)(0, — 1) = ij){t, x). Therefore, from the inequality (4.3) 
we have —'ip(t,x) ^ Px and xf{t,x) ^ —px for each (pt,Px) G dU{t,x). Since —pt ^ —'tf{t,x) 
and —px = ^^{tjx) for each {pt,Px) G dU{t,x), then by the definition of H we have 

-pt + H{t,x,-px) = -pt-2px-ilj(t,x) 

^ —tp{t,x) + 2'ip(t,x) — 'ip{t,x) 

= 0. 
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Case 3. Let x > t and t = T. Then the equality A[/(t,x)(—1,0) = —ip{t,x) holds. 
Therefore, from the inequality (4.3) we have —'ijj{t,x) ^ —pt for each {pt,Px) G dU{t,x). 
Moreover, A{7(t, a;)(0,1) = —^{t,x) and A[/(t, a;)(0, — 1) = ii){t,x). Therefore, from the 
inequality (4.3) we get —il){t,x) ^ Px and ip(t,x) ^ —px for each {pt,Px) G dU{t,x). Since 
—pt ^ —'ip{t,x) and —px = 'tp{t,x) for each {pt,Px) G dU{t,x), then by the dehnition of H 
we have 

-pt + H{t,x,-px) = -pt - 2px - ^p{t,x) 

^ —'ip{t,x) + 2'ip{t,x) — 'ip{t,x) 

= 0 . 

Case 4. Let x = t and t G [0,T]. Then the equality AU{t,x){0,l) = —oo holds. 
If {pt,Px) G dU{t,x), then from the inequality (4.3) we have the contradiction —oo = 
AU{t, a;)(0,1) ^ Pa, G M. Therefore dU{t, x) = 0. 

Case 5. Let x < t and t G ]0,r[. Then the function U is differentiable at {t,x). 
Therefore, dU{t,x) = {{pt,Px)}, where pt = 0 = Px- By the definition of H we have 

-pt + H{t,x,-px) = 0 + H{t,x,0) 

= 0 . 

Case 6. Let x < t and t = 0. Then the equality AU{t, a;)(l, 0) =0 holds. Therefore, from 
the inequality (4.3) we obtain 0 p* for each {pt,Px) G dU{t, x). Moreover, AU{t, a:)(0,1) = 
0 and AU{t, a;)(0, —1) =0. Therefore, from the inequality (4.3) we have 0 ^ Px and 0 ^ —px 
for each {pt,Px) G dU{t,x). Since —pt > 0 and —px = 0 for each {pt,Px) G dU{t,x), then 
by the definition of H we have 

-pt + H{t,x,-px) ^ 0 + iL(t,x, 0) 

= 0 . 

Case 7. Let x < t and t = T. Then the equality AU{t,x){—l,0) = 0 holds. There¬ 
fore, from the inequality (4.3) we have 0 ^ —pt for each {pt,Px) G dU{t,x). Moreover, 
AU{t,x){0,l) = 0 and AU{t, x){0, —1) = 0. Therefore, from the inequality (4.3) we get 
0 ^ Pa; and 0 ^ —px for each {pt,Px) G dU{t,x). Since —pt ^ 0 and —px = 0 for each 
{Pt,Px) G dU{t,x), then by the definition of H we have 

-pt + H{t,x,-px) < 0 + H{t,x,0) 

= 0 , 

that finishes the proof. □ 

4.2. Second solution. Let the function V : [0, T] x R —>■ M be given by the formula 
( U{t,x) if x^t, 

(4.5) V{t,x) = < 1 — exp {—2^t — x) if 2t — T^x<t, 

[ 1 if x<2t-T. 

Theorem 4.3. The function V given by (4.5) is bounded lower semicontinuous solution of 
the HJB equation with the Hamiltonian (3.2) and the terminal condition (4.1). 

Proof. It is not difficult to notice that the function V is lower semicontinuous, bounded 
and V{T,x) = g{x). We prove that the function V satisfies conditions (1.5). Since V{t,x) = 
U{t,x) for X ^ t and x < 2t — T, than by the Theorem 4.2 it is sufficient to show that V 
satisfies conditions (1.5), when 2t — T ^ x < t. To do it we consider two cases. 
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Case 1. Let 2t — T ^ x < t and t G ]0,T'[. Then AV{t, x){l,2) = —'ip{t,x) and 
AV{t,x){—l,—2) = ip{t,x). Therefore, from the inequality (4.3) we havea;) pt + 2px 
and tp{t,x) ^ —pt — 2px for each {pt,Px) G dV{t,x). Moreover, AV{t,x){0, 1) = —'ilj{t,x), so 
by the inequality (4.3) we get —ipit, x) ^ Px for each {pt,Px) G dV{t, x). Since —px ^ ipit, x) 
and 'ip{t,x) = —pt — 2px for all {pt,Px) G dV{t,x), then from the definition of H we have 

-pt + H{t,x,-px) = -pt-2px-ip{t,x) 

= ip{t,x) - tp{t,x) 

= 0 , 

Case 2. Let 2t — T ^ x < t and t = 0. Then AV{t, x){l,2) = —'>p(t,x). Therefore, 
from the inequality (4.3) we have —'ilj{t,x) pt + 2px for all {pt,Px) G dU{t,x). Besides, 
A14(f,a;)(0,1) = —i/>(t, x), so from the inequality (4.3) we have —■i/'(t, x) > Pa, for Si\\{pt,Px) G 
dV{t,x). Since —px ^ ipitjx) and —pt — 2px ^ il){t,x) for all {pt,Px) G dV{t,x), then by 
the definition of H we have 

-pt + H{t,x,-px) = -pt-2px-tp{t,x) 

> ip{t,x) —'tp{t,x) 

= 0 , 

that ends the proof. □ 


5. The value function 

In this section we show that the function V given by (4.5) is the value function, in the sense 
of Definition 1.3, corresponding to the Lagrangian (3.4) and the cost function (4.1). It is 
not difficult to prove that a trajectory x : [to,T] —>■ R given by x{t) = 2{t — tg) + xg for 
xg ^ 2to — T and x(t) = xg for xg < 2tg — T satisfy 

(5.1) V{tg,xg) = g{x{T))+ f L{t,x{t),x{t))dt. 

Jto 

The problem to prove is on the basis of the Dehnition 1.1, that the trajectory x(-) given 
above is optimal trajectory from Theorem 2.1. Therefore, to prove that the function (4.5) 
is the value function we use the paper [17] methods. 

5.1. Sketch of method. Notation \ H means that ^ Hn+i ^ H for every 
n G N and iL„ converges pointwise to H. Similarly L„ L means that L„ ^ ^ L for 

all n G N and L„ converges pointwise to L. Furthermore, we need the following results: 

Proposition 5.1 ([17, Cor. 3.2]). Suppose that Ln, L andHn, H are connected hy relations 

(1.1) and (1.2). Then the following properties are equivalent: 

(i) The Hamiltonians Hn, H satisfy (H1)-(H3) and Hn H, 

(ii) The Lagrangians Ln, L satisfy (L1)-(L4) and Ln L. 

Theorem 5.2 ([17, Thm. 3.3]). Suppose that Ln , L satisfy (L1)-(L4) and Ln L. Let 
gn, g be hounded from below lower semicontinuous funetions and gn g. IfVn, V are value 
functions corresponding to Ln, gn o-nd L, g respectively, then Vn V. 

We construct a sequence of Hamiltonians {Hn)n^n such that Hn satisfy (H1)-(H4) to¬ 
gether with (SLC) and converge: \ H. Then by Proposition 5.1 and Theorem 5.2 the 

value functions Vn corresponding to equations HJB with Hamiltonians Hn and cost func¬ 
tions gn = g converge to the value function V. Since Hamiltonians Hn satisfy in addition 
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the condition (SLC), then the value functions U„ by Theorem 2.3 are unique lower semi- 
continuous solutions. Therefore, to find the value function V, one needs to hnd solutions of 
equations HJB with Hamiltonians and the cost function g and then take the limit. 

Remark 5.3 ([17, Rem. 3.4]). Let the value functions 14,, V be as in Theorem 5.2. It can 
be proved that if functions Xn(-) are optimal trajectories of V„(to, xq), then accumulating 
points of the sequence (a;„(-))„gN are optimal trajectories of the function V(to,xo). 


We use the above remark to hnd a solution to HJB equation. 

5.2. Approximation of the Hamiltonian. Let the function cr : [0, -|-oo[—>■ R be given 
as i7(z) = y/z, and functions : [0, -|-oo[ —>• R by 


(5.2) 


CTn(2) = 


1 

y/n 


if 

if Osf z < ^. 


We notice that functions (t„ satisfy locally the Lipschitz continuity and cr„ \( er. Using 
functions cr„ we dehne functions : [0, T] x R —>■ R by 


(5.3) 


(fn(,t,x) = cr„(|t-a;|)exp[2cr„(|t-a;|)]. 


Then functions (pn also satisfy locally the Lipschitz continuity and (/?„ p. 
Hamiltonians Hn :[0,r]xRxR—^-R are dehned by the formula 


(5.4) 


Hn{t,X,p) = 


2bl 


0 

1 

iprt{t,x) 


*/ 2H 4 
*/ 2H > 


It is not difficult to notice that Hamiltonians Hn{t,x,p) given by (5.4) are continuous, 
convex with respect to p and have linear growth in p, so they satisfy conditions (H1)-(H4). 
Moreover iL„ \ iL, because pn \ P- Similarly to the proof of Case 2 in Theorem 3.2 we 
can prove that Hamiltonians (5.4) satisfy the condition (SLC). 

Lagrangians L„ : [0, T] x R x R —>■ R U {+oo} are dehned by the formula 


(5.5) 


Ln{t,X,v) = 


2^5b) 1^1 ^ 2, 

-foo if |u| > 2. 


It is easy to prove that Lagrangians (5.5) satisfy conditions (L1)-(L5) and L. More¬ 

over, similarly like in the proof of Proposition 3.5 we can show that the Hamiltonian (5.4) 
is Legendre-Fenchel transform of the Lagrangian (5.5) with respect to the last variable. 

5.3. Value functions 14. We suppose that V given by (4.5) is the value function. 
Then by equalities (5.1) the optimal trajectory is given by formula x{t) = 2{t — to) + xg 
for xq ^ 2to — T and x{f) = xq for xq < 2to — T. Using Remark 5.3 we can expect that 
value functions Vnftg, xq), corresponding to Lagrangians (5.5) and a cost function (4.1), have 
optimal trajectories given by formulas x„(t) = 2(t — to)+xo for xg ^ 2to — T and T„(t) = xg 
for Xg < 2tg — T. If the above consideration is true then the following equality holds 

I4(4j^o) — ll(^n(L')) J- / Lji{t ^ Xn{t) ^ Xn{t)) dt. 

Jto 

Calculating in the above equality functions Vn : [0, T] x R —>■ R we get the formula: 
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Vn{t,x) = 

For X ^ 2t — T we have 

(a) if |t — x| < 1/n and T — 2t + x ^ 1 /n, then 

Vn{t,x) = (t — x)-\/nexp(—2/v^) + (1 + 1/v^) exp(—2/v^) — 1, 

(b) if \t — x\ < 1/n and T — 2t + x ^ 1/n, then 

Vn{t,x) = exp(—2-\/r — 2t + a; ) + (r — t)-\/nexp(—2/-\/n) — 1, 

(c) ii t — X ^ 1/n and T — 2t + x ^ 1/n, then 

Vn{t,x) = 2(1 + 1/v^) exp(—2/v^) — exp(—2-\/t — a; ) — 1, 

(d) iit — x^ 1/n and T — 2t + x ^ 1/n, then 

Vn{t,x) = [I + y/n{T — 2t + x) + 1/y/n]eyiY>{—2/y/n) 

+ exp(—2-\/T — 2t + a; ) — exp(—2-\/t — a; ) — 1, 

(e) if 1/n < a: — t, then Vn{t, x) = exp{—2y/x — t) — 1. 

For X <2t — T we have Vn{t, x) = 1. 

Remark 5.4. In fact we do not know if the function V given by (4.5) is the value function. 
So we also do not know if functions given by above formulas are value functions. The 
following results confirm that functions and V are value functions. 

Proposition 5.5. Let Hamiltonians Hn be given by (5.4), the cost function g by (4.1), and 
the function V by (4.5). Then functions V„ given by the above formula are bounded lower 
semicontinuous solutions of equations HJB with Hamiltonians Hn and the cost function g, 
moreover —>• F. 

Proof. It is not difficult to notice that functions 14, are bounded (ie. —I 414(‘5 •) 4 1) and 
Vn{T,x) = g{x). We can prove that functions 14, are lower semicontinuous on [0,T] x M. 
Furthermore, functions 14 are differentiable on A = {{t,x) G ]0,T[x]R : x > 2t — T} and 
B = {(4a^) G ]0,T[xIR : X <2t — T}, moreover dV{t,x) = 0 for a; = 2t — T and t G [0,T], 
in addition F„ satisfy conditions (1.5) with Hamiltonians and F„ —>■ F. □ 

Remark 5.6. Since functions F„ are lower semicontinuous solutions of equations HJB with 
Hamiltonians and the cost function g, so by Theorem 2.3 the functions F„ are value 
functions. Therefore, from Theorem 5.2 the function F given by (4.5) is the value function, 
because Vn ^ V. 


6. Regularity of Hamiltonian 

By Remark 3.1 the function (p given by the formula (3.1) does not satisfy the local Lipschitz 
continuity. We show that it is the reason of the lack of the uniqueness solution of the HJB 
equation with Hamiltonian (3.2). Indeed, let us replace the function p given by (3.1) by 
the function ip{t, x) = \t — a;| exp(2|t — xj). Next define Hamiltonian H by the formula (3.2) 
using the function ip. Then Hamiltonian H satisfies conditions (HI)-(H4). Moreover, we 
show that using the local Lipschitz condition of the function ip Hamiltonian H satisfies the 
Loewen-Rockafellar condition (2.2). However, it does not satisfies the Lipschitz continuity 
(SLC) that easily follows from the proof of Proposition 3.4. Firstly, it means that we cannot 
reverse the first of implication (2.3). Secondly, by the result of Galbraith [II] we know 
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that the value function is the nnique solution of the HJB equation with Hamiltonian H. 
Therefore, the reason of nonuniqueness of solutions of the HJB equation with Hamiltonian 

(3.2) is the lack of the local Lipschitz continuity of the function (3.1). 

Let the function ip be given by (3.1) and w(- ,r) be modulus of continuity of the <p on 
the set [0, T] x rB. Then the following proposition holds. 

Proposition 6.1. Let the Lagrangian L be given by (3.4) and the function p be given 
by (3.1). Moreover, let w(- ,r) be modulus of continuity of p . Then for every t,s G [0,T] 
and x,y G rB, every v G dom L(t, x, •) there exists v G dom L(s, y, ■) such that 

(i) v| < 2(1 + |u| + \L{t,x,v)\)w{\s -t\ + \y- x\,r); 

(ii) L{s,y,iy) ^ L{t,x,v) + 2(1 + |v| + \L{t,x,v)\)w{\s - t\ + \y - x\,r). 

Proof. To prove the proposition we consider 3 cases. 

Case 1. Let t ^ x and p{s,y)/p{t, x) ^ 1. Then for v G doia L{t,x,-) we put v = 
V p{s, y)/p(t, x). Notice that v G domL(s, y, •) and 

LS(i) = 2L{t,x,v)\p(s,y) - p(t,x)\ ^ RS(i), 

LS(ii) ^ L{t,x,v) ^ RS(ii). 

Case 2. Let t x and p{s,y)/p{t,x) > 1. Then for v G domL(t,x,-) we put ly = v. We 
notice that v G dom L(s,y, ■) and 

LS(i) = 0 < RS(i), 

LS(ii) ^ L{t,x,v) ^ RS(ii). 

Case 3. Let t = x. If v G domL{t,x,-), then v = 0. Put 1 ^ = 0. We notice that 
v G dom L(s, y, •) and 

LS(i) = 0 ^ RS(i), 

LS(ii) = 0 < RS(ii). 

Therefore, the proposition is proven. □ 

Proposition 6.2. Suppose that the Lagrangian L satisfy (L1)-(L5). Then the condition 

(2.2) holds, if the following condition is true 

(A) For every r > 0 there exists k > 0 such that for every t,s G [0, T] and x,y G rB, every 
v G dom L{t,x, ■) there exists v G dom L(s,7/, •) such that 
(i) ^ A:(l + |v| + \L{t,x,v)\)(\s -t\ + \y-x\); 

(ii) L{s,y,v) < L{t,x,v) + k{l + |v| + \L{t,x,v)\){\s -t\ + \y-x\). 

Proof. We extend L in the following way: L{t, x, v) := L{0, x, v) for t < 0 and L(t, x, v) := 
L{T, X, v) for t > T. Fix r > 0 and choose fc > 0 for 1 + r in such a way that the condition 
(A) holds. Let t G [0,T], x G rB, u G M" and {wi,W 2 ,p) G dL{t,x,v). Without loss of 
generality we can assume that {wi,W 2 ) ^ 0. Let {tn,Xn) '■= (t,x) + (wi,W 2 )/[n\(wi,W 2 )\], 
then Xn G (1 + r)B. Since v G dom L(t, x,-), then there exist Vn G domL(f„, •) such that 

(i) \Vn - u| < 2fc(l + |v| + \L{t,X,v)\) \{tn,Xn) “ it,x)\, 

(ii) L{tn,Xn,Vn) ^ L{t,X,v) + 2fc(l + |u| + \L{t,X,v)\) \(tn,Xn) - it,x)\. 

We put bn := n(u„ — v) and notice that (i) implies that |&„| < 2fc(l + |v| + \L{t,x,v)\). 
Therefore, a sequence {&n}ngN is bounded, so there exists a subsequence (denoted again by) 
bn —t b. Obviously, the following inequality is satisfied 

(6.1) \b\ ^2k{l + \v\ + \L{t,x,v)\) 
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Since {wi,W 2 ,p) G dL{t,x,v), then the property [23, s. 301] and (ii) imply 


( 6 . 2 ) 


^ 1' . r '^n') A(t, X, v) 

< limint- - -r- - -- 

" |(t„,x„) - (t,x)| 

< 2fc(l + |i;| + |L(t, X, i;)|). 


From the inequality 6.2 and 6.1 for {wi,W 2 ,p) G dL(t,x,v) we obtain 
1 (^ 1 ,^ 2)1 < 2A:(1 + |v| + |L(t,x,x)|) + |p||6| 

< 2A:(1 + |x| + |L(t,x,x)|)(l + IpI). 


So the proposition is proven. 


□ 


Remark 6.3. The only difference between the assertion of Proposition 6.1 and the condition 
(A) is contained in modulus. From Proposition 6.1 and 6.2 we obtain that if the function tp 
given by (3.1) is replaced by the function (p(t,x) = |t —x| exp(2|t —x|), then the Hamiltonian 
H given by (3.2) with p satisfies the Lipschitz-type condition (2.2). 

Crandall and Lions [7] constructed two continuous solutions of the transport equation 
(1.8). This construction is based on Beck results in [5]. We know that in the example of 
nonuniqueness of Crandall and Lions Hamiltonian H(t,x,p) = b{x)p cannot satisfy locally 
the Lipschitz continuity. In our example of nonuniqueness Hamiltonian satisfy locally the 
Lipschitz continuity. However, solutions are lower semicontinuous functions. In connection 
to this, there appears a question - if there exist two continuous solutions of HJB with 
the Hamiltonian satisfying locally the Lipschitz continuity? On the basis of results from 
this section we think that the answer to this question is positive. Indeed, we have proved 
that regularity of the function p is responsible for the lack of uniqueness in our example. 
Similarly, in the example of Crandall and Lions the function b is responsible for the lack 
of uniqueness. Besides, we know that in the construction of two continuous solutions in 
the example of Crandall and Lions the significant role is played by Beck functions /, I that 
satisfy the equality 6(x) := f'{f~^{x)) = l'{l~^x). In fact, we are able to construct two 
lower semicontinuous solutions of transport equation using the method of Crandall and 
Lions without Beck result. To do it we need significantly less complex function 6. We 
think that replacing in our example the function p by more subtle Beck function b we 
can construct, using functions / and I, two continuous solutions of HJB equation with 
Hamiltonian satisfying locally the Lipschitz continuity. Notice that the example of Crandall 
and Lions, as opposed to our example, does not consider the meaning of Lipschitz type 
condition in uniqueness results. In particular, it does not consider that the local Lipschitz 
continuity is not sufficient to obtain uniqueness. We recall that in the classical theory of 
differential equations the local Lipschitz continuity is a natural assumption guaranteeing 
uniqueness of the Cauchy problem. 
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